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Abstract We consider a conductance-based neural network inspired by the gener- 
alized Integrate and Fire model introduced by Rudolph and Destexhe in 1996. We 
show the existence and uniqueness of a unique Gibbs distribution characterizing spike 
train statistics. The corresponding Gibbs potential is explicitly computed. These re- 
sults hold in the presence of a time-dependent stimulus and apply therefore to non- 
stationary dynamics. 

1 Introduction 

Neural networks have an overwhelming complexity. While an isolated neuron can 
exhibit a wide variety of responses to stimuli [1], from regular spiking to chaos [2, 
3], neurons coupled in a network via synapses (electrical or chemical) may show an 
even wider variety of collective dynamics [4] resulting from the conjunction of non- 
linear effects, time propagation delays, synaptic noise, synaptic plasticity, and exter- 
nal stimuli [5]. Focusing on the action potentials, this complexity is manifested by 
drastic changes in the spikes activity, for instance when switching from spontaneous 
to evoked activity (see for example A. Riehle's team experiments on the monkey 
motor cortex [6-9]). However, beyond this, complexity may exist some hidden laws 
ruling an (hypothetical) "neural code" [10]. 

One way of unraveling these hidden laws is to seek some regularities or repro- 
ducibility in the statistics of spikes. While early investigations on spiking activities 
were focusing on firing rates where neurons are considered as independent sources, 
researchers concentrated more recently on collective statistical indicators such as 
pairwise correlations. Thorough experiments in the retina [11, 12] as well as in the 
parietal cat cortex [13] suggested that such correlations are crucial for understanding 
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spiking activity. Those conclusions where obtained using the maximal entropy prin- 
ciple [14]. Assume that the average value of observables quantities (e.g., firing rate 
or spike correlations) has been measured. Those average values constitute constraints 
for the statistical model. In the maximal entropy principle, assuming stationarity, one 
looks for the probability distribution which maximizes the statistical entropy given 
those constraints. This leads to a (time-translation invariant) Gibbs distribution. In 
particular, fixing firing rates and the probability of pairwise coincidences of spikes 
lead to a Gibbs distribution having the same form as the Ising model. This idea has 
been introduced by Schneidman et al. in [11] for the analysis of retina spike trains. 
They reproduce accurately the probability of spatial spiking pattern. Since then, their 
approach has known a great success (see, e.g., [15-17]), although some authors raised 
solid objections on this model [12, 18-20] while several papers have pointed out the 
importance of temporal patterns of activity at the network level [21-23]. As a conse- 
quence, a few authors [13, 24, 25] have attempted to define time-dependent models 
of Gibbs distributions where constraints include time-dependent correlations between 
pairs, triplets, and so on [26]. As a matter of fact, the analysis of the data of [1 1] with 
such models describes more accurately the statistics of spatio-temporal spike patterns 
[27]. 

Taking into account all constraints inherent to experiments, it seems extremely 
difficult to find an optimal model describing spike trains statistics. It is in fact likely 
that there is not one model, but many, depending on the experiment, the stimulus, 
the investigated part of the nervous system and so on. Additionally, the assumptions 
made in the works quoted above are difficult to control. Especially, the maximal en- 
tropy principle assumes a stationary dynamics while many experiments consider a 
time-dependent stimulus generating a time-dependent response where the stationary 
approximation may not be valid. At this stage, having an example where one knows 
the explicit form of the spike trains, probability distribution would be helpful to con- 
trol those assumptions and to define related experiments. 

This can be done considering neural network models. Although, to be tractable, 
such models may be quite away from biological plausibility, they can give hints on 
which statistics can be expected in real neural networks. But, even in the simplest ex- 
amples, characterizing spike statistics arising from the conjunction of non-linear ef- 
fects, time propagation delays, synaptic noise, synaptic plasticity, and external stimuli 
is far from being trivial on mathematical grounds. 

In [28], we have nevertheless proposed an exact and explicit result for the char- 
acterization of spike trains statistics in a discrete-time version of Leaky Integrate- 
and-Fire neural network. The results were quite surprising. It has been shown that 
whatever the parameters value (in particular synaptic weights), spike trains are dis- 
tributed according to a Gibbs distribution whose potential can be explicitly com- 
puted. The first surprise lies in the fact that this potential has infinite range, namely 
spike statistics has an infinite memory. This is because the membrane potential evo- 
lution integrates its past values and the past influence of the network via the leak 
term. Although leaky integrate and fire models have a reset mechanism that erases 
the memory of the neuron whenever it spikes, it is not possible to upper bound the 
next time of firing. As a consequence, statistics is non-Markovian (for recent exam- 
ples of non-Markovian behavior in neural models see also [29]). The infinite range of 
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the potential corresponds, in the maximal entropy principle interpretation, to having 
infinitely many constraints. 

Nevertheless, the leak term influence decays exponentially fast with time (this 
property guarantees the existence and uniqueness of a Gibbs distribution). As a con- 
sequence, one can approximate the exact Gibbs distribution by the invariant proba- 
bility of a Markov chain, with a memory depth proportional to the log of the (discrete 
time) leak term. In this way, the truncated potential corresponds to a finite number 
of constraints in the maximal entropy principle interpretation. However, the second 
surprise is that this approximated potential is nevertheless far from the Ising model 
or any of the models discussed above, which appear as quite bad approximations. In 
particular, there is a need to consider n-uplets of spikes with time delays. This mere 
fact asks hard problems about evidencing such type of potentials in experiments. Es- 
pecially, new type of algorithms for spike trains analysis has to be developed [30]. 

The model considered in [28] is rather academic: time evolution is discrete, 
synaptic interactions are instantaneous, dynamics is stationary (the stimulus is time- 
constant) and, as in a leaky integrate and fire model, conductances are constant. It 
is therefore necessary to investigate whether our conclusions remain for more real- 
istic neural networks models. In the present paper, we consider a conductance-based 
model introduced by Rudolph and Destexhe in [31] called "generalized Integrate and 
Fire" (gIF) model. This model allows one to consider realistic synaptic responses 
and conductances depending on spikes arising in the past of the network, leading to 
a rather complex dynamics which has been characterized in [32] in the deterministic 
case (no noise in the dynamics). Moreover, the biological plausibility of this model 
is well accepted [33, 34]. 

Here, we analyze spike statistics in the gIF model with noise and with a time- 
dependent stimulus. Moreover, the post-synaptic potential profiles are quite general 
and summarize all the examples that we know in the literature. Our main result is to 
prove the existence and uniqueness of a Gibbs measure characterizing spike trains 
statistics, for all parameters compatible with physical constraints (finite synaptic 
weights, bounded stimulus, and positive conductances). Here, as in [28], the cor- 
responding Gibbs potential has infinite range corresponding to a non-Markovian dy- 
namics, although Markovian approximations can be proposed in the gIF model too. 
The Gibbs potential depends on all parameters in the model (especially connectivity 
and stimulus) and has a form quite more complex than Ising-like models. As a by- 
product of the proof of our main result, additional interesting notions and results are 
produced such as continuity, with respect to a raster, or exponential decay of memory 
thanks to the shape of synaptic responses. 

The paper is organized as follows. In Section 2, we briefly introduce integrate and 
fire models and propose two important extensions of the classical models: the spike 
has a duration and the membrane potential is reset to a non-constant value. These 
extensions, which are necessary for the validity of our mathematical results, render 
nevertheless the model more biologically plausible (see Section 9). One of the keys of 
the present work is to consider spike trains (raster plots) as infinite sequences. Since 
in gIF models, conductances are updated upon the occurrence of spikes, one has to 
consider two types of variables with distinct type of dynamics. On the one hand, the 
membrane potential, which is the physical variable associated with neurons dynam- 
ics, evolves continuously. On the other hand, spikes are discrete events. Conductances 
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are updated according to these discrete-time events. The formalism introduced in Sec- 
tions 2 and 3 allows us to handle properly this mixed dynamics. As a consequence, 
these sections define gIF model with more mathematical structure than the original 
paper [31] and mostly contain original results. Moreover, we add to the model sev- 
eral original features such as the consideration of a general form of synaptic profile 
with exponential decay or the introduction of noise. Section 4 proposes a prelimi- 
nary analysis of gIF model dynamics. In Sections 5 and 6, we provide several useful 
mathematical propositions as a necessary step toward the analysis of spike statistics, 
developed in Section 7, where we prove the main result of the paper: existence and 
uniqueness of a Gibbs distribution describing spike statistics. Sections 8 and 9 are 
devoted to a discussion on practical consequences of our results for neuroscience. 



2 Integrate and fire model 

We consider the evolution of a set of N neurons. Here, neurons are considered as 
"points" instead of spatially extended and structured objects. As a consequence, we 
define, for each neuron k e {1, . . . , N], a variable Vk(t) called the "membrane poten- 
tial of neuron k at time t" without specification of which part of a real neuron (axon, 
soma, dendritic spine, . . . ) it corresponds to. Denote V(t) the vector (Vk(t))^ =1 . 

We focus here on "integrate and fire models", where dynamics always consists of 
two regimes. 

2.1 The "integrate regime" 

Fix a real number 6 called the "firing threshold of the neuron". 1 Below the threshold, 
Vk < 0, neuron £'s dynamics is driven by an equation of the form: 

at 

where Ck is the membrane capacity of neuron k. In its most general form, the neuron 
&'s membrane conductance gk > 0 depends on Vk plus additional variables such as 
the probability of having ionic channels open (see, e.g., Hodgkin-Huxley equations 
[35]) as well as on time t. The explicit form of gk in the present model is developed 
in Section 3.4. The current ik typically depends on time t and on the past activity of 
the network. It also contains a stochastic component modeling noise in the system 
(e.g., synaptic transmission, see Section 3.5). 



We assume that all neurons have the same firing threshold. The notion of threshold is already an approx- 
imation which is not sharply defined in Hodgkin-Huxley [35] or Fitzhugh-Nagumo [40, 41] models (more 
precisely it is not a constant but it depends on the dynamical variables [55]). Recent experiments [62-64] 
even suggest that there may be no real potential threshold. 
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Fig. 1 Time course of the membrane potential in our model. The blue dashed curve illustrates the shape 
of a real spike, but what we model is the red curve. 



2.2 LIF model 

A classical example of integrate and fire model is the Leaky Integrate and Fire's (LIF) 
introduced in [36] where Equation (1) reads: 

^ = _Vk + ik(t)_ 
dt t l C k 

where gk is a constant and r L = ^ is the characteristic time for membrane potential 
decay when no current is present ("leak term"). 

2.3 Spikes 

The dynamical evolution (1) may eventually lead Vk to exceed 0. If, at some time t, 
Vk(t) = 6, then neuron k emits a spike or "fires". In our model, like in biophysics, 
a spike has a finite duration 8 > 0; this is a generalization of the classical formula- 
tion of integrate and fire models where the spike is considered instantaneous. On 
biophysical grounds, 8 is of order of a millisecond. Changing the time units, we may 
set 8 = 1 without loss of generality. Additionally, neurons have a refractory period 
r re f r > 0 where they are not able to emit a new spike although their membrane poten- 
tial can fluctuate below the threshold (see Figure 1). Hence, spikes emitted by a given 
neuron are separated by a minimal time scale 

^sep = + r re f r . (3) 
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2.4 Raster plots 



In experiments, spiking neuron activity is represented by "raster plots", namely a 
graph with time in abscissa, and a neuron labeling in ordinate such that a vertical bar 
is drawn each "time" a neuron emits a spike. Since spikes have a finite duration 8 
such a representation limits the time resolution: events with a time scale smaller than 
8 are not distinguished. As a consequence, if neuron 1 fires at time t\ and neuron 2 at 
time t2 with \t2 — h | < 8 — 1 the two spikes appear to be simultaneous on the raster. 
Thus, the raster representation introduces a time quantization and has a tendency to 
enhance synchronization. In gIF models, conductances are updated upon the occur- 
rence of spikes (see Section 3.2) which are considered as such discrete events. This 
could correspond to the following "experiment". Assume that we measure the spikes 
emitted by a set of in vitro neurons and that we use this information to update the 
conductances of a model, in order to see how this model "matches" the real neu- 
rons (see [34] for a nice investigation in this spirit). Then, we would have to take 
into account that the information provided by the experimental raster plot is discrete, 
even if the membrane potential evolves continuously. The consequences of this time 
discretization as well as the limit 8 -> 0 are developed in the discussion section. 

As a consequence, one has to consider two types of variables with distinct type of 
dynamics. On the one hand, the membrane potential, which is the physical variable 
associated with neuron dynamics, evolves with a continuous time. On the other hand, 
spikes, which are the quantities of interest in the present paper, are discrete events. 
To properly define this mixed dynamics and study its properties, we have to model 
spikes times and raster plots. 



2.5 Spike times 



If, at time t, Vk(t) = 0, a spike is registered at the integer time immediately after 
t, called the spike time. Choosing integers for the spike time occurrence is a direct 
consequence of setting 8 = 1. Thus, to each neuron k and integer n, we associate a 
"spiking state" defined by: 



co k (n) = 



1 if 3t e ]n - 1, n] such that V k (t) 
0 otherwise. 



For convenience and in order to simplify the notations in the mathematical de- 
velopments, we call [t] the largest integer which is < t (thus [—1.2] = —2 and 
[1.2] = 1). Thus, the integer immediately after t is [t + 1] and we have therefore 
that cok([t + 1]) = 1 whenever Vk(t) = 6. Although, characteristic events in a raster 
plot are spikes (neuron fires), it is useful in subsequent developments to consider also 
the case when neuron is not firing (cokW = 0). 



2.6 Reset 



In the classical formulation of integrate and fire models, the spike occurs simultane- 
ously with a reset of the membrane potential to some constant value V re set, called the 
"reset potential". Instantaneous reset is a source of pathologies as discussed in [32, 
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37] and in the discussion section. Here, we consider that reset occurs after the time 
delay r sep > 1 including spike duration and refractory period. We set: 

V k (t) =0^ V k ([t + T sep ]) = Vreset- (4) 

The reason why the reset time is the integer number [t + r sep ] instead of the real 
t + r sep is that it eases the notations and proofs. Since the reset value is random (see 
below and Figure 1), this assumption has no impact on the dynamics. 

Indeed, in our model, the reset value V re set is not a constant. This is a Gaussian 
random variable with mean zero (we set the rest potential to zero without loss of gen- 
erality) and variance a| > 0. In this way, we model the spike duration and refractory 
period, as well as the random oscillations of the membrane potential during the re- 
fractory period. As a consequence, the value of V* when the neuron can fire again 
is not a constant, as it is in classical IF models. A related reference (spiking neurons 
with partial reset) is [38]. The assumption that a| > 0 is necessary for our mathemat- 
ical developments (see the bounds (37)). We assume o\ to be small to avoid trivial 
and unrealistic situations where V re set > 0 with a large probability leading the neuron 
to fire all the time. Note, however, that this is not a required assumption to estab- 
lish our mathematical results. We also assume that, in successive resets, the random 
variables V re set are independent. 

2.7 The shape of membrane potential during the spike 

On biophysical grounds, the time course of the membrane potential during the spike 
includes a depolarization and re-polarization phase due to the non-linear effects of 
gated ionic channels on the conductance. This leads to introduce, in modeling, addi- 
tional variables such as activation/inactivation probabilities as in the Hodgkin-Huxley 
model [35] or adaptation current as, e.g., in FitzHugh-Nagumo model [39-42] (see 
the discussion section for extensions of our results to those models). Here, since we 
are considering only one variable for the neuron state, the membrane potential, we 
need to define the spike profile, i.e., the course of Vk(t) during the time interval 
(t, [t + T sep ]). It turns out that the precise shape of this profile plays no role in the de- 
velopments proposed here, where we concentrate on spike statistics. Indeed, a spike 
is registered whenever Vk(t) = 6, and this does not depend on the spike shape. What 
we need is therefore to define the membrane potential evolution before the spike, 
given by (1), and after the spike, given by (4) (see Figure 1). 

2.8 Mathematical representation of raster plots 

The "spiking pattern" of the neural network at integer time n is the vector co(n) = 
(cok(n))fc =1 . For in < n, we note (Jd n m — {co(m)co(m + 1) • • -co(n)} the ordered se- 
quence of spiking patterns between m and n. Such sequences are called spike blocks. 
Additionally, we note that (xll\~ X (D n nx = co^, the concatenation of the blocks coll ~ 1 
and co% . 

Call A = {0, 1}^ the set of spiking patterns (alphabet). An element of X = A z , 
i.e., a bi-infinite ordered sequence co = {co^n)}^^^ of spiking patterns, is called a 
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"raster plot". It tells us which neurons are firing at each time n e Z. In experiments, 
raster plots are obviously finite sequences of spiking pattern but the extension to Z, 
especially the possibility of considering an arbitrary distant past (negative times), is 
a key of the present work. In particular, the notation octL^ refers to spikes occurring 
from —oo to n. 

To each raster co e X and each neuron index j = 1 , . . . , N, we associate an ordered 
(generically infinite) list of "spike times" {V- (co)}^ =l (integer numbers) such that 
tJ\co) is the r-th time of firing of neuron j in the raster co. In other words, we 
have coj(n) = 1 if and only if n = tJ\co) for some r = 1, . . . , +oo. We use here the 
following convention. The index k is used for a post-synaptic neuron while the index 
j refers to pre-synaptic neurons. Spiking events are used to update the conductance 
of neuron k according to spikes emitted by pre-synaptic neurons. That is why we 
label the spike times with an index j . 

We introduce here two specific rasters which are of use in the paper. We note 
the raster such that cok(n) = 0, VA: = 1, . . . , N, Vn e Z (no neuron ever fires) and Q\ 
the raster cok(n) = 1, V/ = 1, . . . , N, Vn e Z (each neuron is firing at every integer 
time). 

Finally, we use the following notation borrowed from [43]. We note, for n e Z, 
m > 0, and r integer: 

co ^ co if co(r) = co' (r),Vr e {n — m, ... ,n}. (5) 

For simplicity, we consider that r re f, the refractory period, is smaller than 1 so 
that a neuron can fire two consecutive time steps (i.e., one can have co^in) = 1 and 
cok(n + 1) = 1). This constraint is discussed in Section 9.2. 

2.9 Representation of time-dependent functions 

Throughout the paper, we use the following convention. For a real function of t and 
co, we write f(t,co) for f(t, co^^) to simplify notations. This notation takes into ac- 
count the duality between variables such as membrane potential evolving with respect 
to a continuous time and raster plots labeled with discrete time. Thus, the function 
fit, co) is a function of the continuous variable t and of the spike block a/!^, where 
by definition [t] < t, namely f(t,co) depends on the spike sequences occurring be- 
fore t . This constraint is imposed by causality. 

2.10 Last reset time 

We define Tk(t, co) as the last time before t where neuron &'s membrane potential has 
been reset, in the raster co. This is — oo if the membrane potential has never been reset. 
As a consequence of our choice (4) for the reset time Tk(t, co) is an integer number 
fixed by t and the raster before t. The membrane potential value of neuron k at time t 
is controlled by the reset value V re set at time Tk(t, co) and by the further subthreshold 
evolution (1) from time Tk(t, co) to time t. 
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3 Generalized integrate and fire models 

In this paper, we concentrate on an extension of (2), called "generalized Integrate- 
and-Fire" (gIF), introduced in [31], closer to biology [33, 34], since it considers more 
seriously neurons interactions via synaptic responses. 

3 . 1 Synaptic conductances 

Depending on the neurotransmitter they use for synaptic transmission (AMPA, 
NMDA, GABA A, GABA B [44]), neurons can be excitatory (population £ ) or in- 
hibitory (population X). This is modeled by introducing reversal potentials E + for 
excitatory (typically E + ~ 0 mV for AMPA and NMDA) and E~ for inhibitory 
(E~ ~ -70 mV for GABA A and E~ ~ -95 mV for GABA B). We focus here 
on one population of excitatory and one population of inhibitory neurons although 
extensions to several populations may be considered as well. Also, each neuron is 
submitted to a current h(t). We assume that this current has some stochastic compo- 
nent that mimics synaptic noise (Section 3.5). 

The variation in the membrane potential of neuron k at time t reads: 

C k ^ = -gL,k(Vk ~ El) ~ gf\t)(V k - E + ) - g™(t)(V k - E~) + /*(*), (6) 

where gL,k is a leak conductance, El < 0 is the leak reversal potential (about 
—65 mV), g^, (t) the conductance of the excitatory population and (t) the con- 
ductance of inhibitory population. They are given by: 

8k } C) = I>*/(0; g^(t) = Y J gk j {t), (7) 

where gkj is the conductance of the synaptic contact j —> k. 
We may rewrite Equation (6) in the form (1) setting 

gk(f) = g Lt k + gi e) (t)+g^ ) (f) 9 

and 

h(t) = g L , k E L + gf\t)E + + gf\t)E~ + I k {t). 

3.2 Conductance update upon a spike occurrence 

The conductances gkj if) in (7) depend on time t but also on pre-synaptic spikes 
occurring before t. This is a general statement, which is modeled in gIF models as 

(r) 

follows. Upon arrival of a spike in the pre-synaptic neuron j at time tj (co), the 
membrane conductance of the post- synaptic neuron k is modified as: 

gkj(t) = gkj{tf\co)) + G kj a kj (t - f) r) (£»)), t > tf\w). (8) 

In this equation, the quantity Gkj > 0 characterizes the maximal amplitude of the 
conductance during a post- synaptic potential. We use the convention that Gkj =0 if 
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and only if there is no synapse between j and k. This allows us to encode the graph 
structure of the neural network in the matrix G with entries Gkj . Note that the Gkj 's 
can evolve in time due to synaptic plasticity mechanisms (see Section 9.4). 

The function otkj (called "alpha" profile [44]) mimics the time course of the synap- 
tic conductance upon the occurrence of the spike. Classical examples are: 

a kj (t)=e~^H(t), (9) 

(exponential profile) or: 

a k j(t) = —e~VH(t), (10) 

with H the Heaviside function (that mimics causality) and tkj is the characteristic 
decay times of the synaptic response. Since Ms a time, the division by tkj ensures 
that otkj(t) is a dimensionless quantity: this eases the legibility of the subsequent 
equations on physical grounds (dimensionality of physical quantities). 

Contrarily to (9) the synaptic profile (10), with otkj (0) = 0 while otkj (0 is maximal 
for t = Tkj , allows one to smoothly delay the spike action on the post-synaptic neuron. 
More general forms of synaptic responses could be considered as well. For example, 
the a profile may obey a Green equation of type [45]: 

1=0 

where k = 1, aj^ = aj^ = 1, corresponds to (9), and so on. 
3.3 Mathematical constraints on the synaptic responses 

In all the paper, we assume that the c^/s are positive and bounded. Moreover, we 
assume that: 

a kj (f) ~ 4 e "^ = A/(0. t -> +oo, (11) 
T kj 

for some integer d. So that otkj it) decays exponentially fast as t — > +oo, with a 
characteristic time rjy, the decay time of the evoked post-synaptic potential. This 
constraint matches all synaptic response kernels that we know (where typically d = 
0, 1) [44, 45]. 

This has the following consequence. For all t, M < t integer, r integer, we have, 
setting t = {t} + [t], where {t} is the fractional part: 

J2 a kj(t ~r)=J2 a */(M ~ r + = ak j( n + 1^)- 

r<M r<M n>[t]—M 

Therefore, as M —> — oo, 



/+oo /t — M\ f ~ M 
f kj (u)Au = P d ( e ^ , 
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where PdQ is a polynomial of degree d. 

We introduce the following (Hardy) notation: if a function f(t) is bounded from 
above, as t -> +oo, by a function ^(/) we write: f(t)<g(t). Using this notation, we 
have therefore: 

Proposition 1 

^ ft - M\ —tzM 

J2<Xkj(t-r)<P d l e j , (12) 

r<M V Tk J J 

as M —> — oo. 



Additionally, the constraint (11) implies that there is some a + < +oo such that, 
for all t, for all k, j: 

J2<Xkj(t-r)<a+. (13) 

r<t 

Indeed, for n > 0 integer, call Akj(n) = sup{a^(/t + x); x e [0, Then, 

+ CX) +oo 

^2 a kj if - r) = ^2 a kj (n + {t})<^2 A kj 0) • 

r<t n =\ n=l 

Due to (11), this series converges (e.g., from Cauchy criterion). We set: 

+oo 

oi+ = max Ajy (/t ) . 
kj , 

On physical grounds, it implies that the conductance gk remains bounded, even if 
each pre-synaptic neuron is firing all the time (see Equation (29) below). 



3.4 Synaptic summation 



Assume that Equation (8) remains valid for an arbitrary number of pre-synaptic spikes 
emitted by neuron j within a finite time interval [s, t] (i.e., neglecting non-linear 
effects such as the fact that there is a finite amount of neurotransmitter leading to 
saturation effects). Then, one obtains the following equation for the conductance gkj 

(r) 

at time t, upon the arrival of spikes at times tj (co) in the time interval [s,t]\ 
gkj (t) = gkj (s) + Gkj ak J (* ~ fi P ' 

{r;s<tf\co)<t} 

The conductance at time s, gkj (s), depends on the neuron j 's activity preceding s. 
This term is therefore unknown unless one knows exactly the past evolution before s. 
One way to circumvent this problem is to taking s arbitrary far in the past, i.e., taking 
s —> —oo in order to remove the dependence on initial conditions. This corresponds 
to the following situation. When one observes a real neural network, the time where 



Springer 



Page 12 of 42 



Cessac 



the observation starts, say t = 0, is usually not the time when the system has begun 
to exist, s in our notations. Taking s arbitrary far in the past corresponds to assuming 
that the system has evolved long enough so that it has reached sort of a "permanent 
regime", not necessarily stationary, when the observation starts. On phenomenologi- 
cal grounds, it is enough to take — s larger than all characteristic relaxation times in 
the system (e.g., leak rate and synaptic decay rate). Here, for mathematical purposes, 
it is easier to take the limit s — > — oo. 

(r) 

Since gkj (t) depends on the raster plot up to time t , via the spiking times tj (co), 
this limit makes only sense when taking it "conditionally" to a prescribed raster plot 
co. In other words, one can know the value of the conductances gkj at time t only if 
the past spike times of the network are known. We write gkj(t, co) from now on to 
make this dependence explicit. 

We set 

a kj (t, co) = lmw-oc T, {ns <t<'\a>)<t} ak j( f ~ 0 (r)(w) ) 

-E {r; , fM< , } ^(^-0 (r) (-))' a*) 

with the convention that = 0 so that otkjit, £1$) = 0 (recall that £"2o is the raster 
such that no neuron ever fires). The limit (14) exists from (13). 

3.5 Noise 

We allow, in the definition of the current h(t) in Equation (6), the possibility of 
having a stochastic term corresponding to noise so that: 

h(t) = *t xt) (0 + <*B&(t), (15) 

where /^ ext ^ (t) is a deterministic external current and i=k(t) a noise term whose ampli- 
tude is controlled by gb > 0. The model affords an extension where gb depends on 
k but this extension is straightforward and we do not develop it here. The noise term 
can be interpreted as the random variation in the ionic flux of charges crossing the 
membrane per unit time at the post-synaptic button, upon opening of ionic channels 
due to the binding of neurotransmitter. 

We assume that §#(0 is a white noise, §#(0 = ^ where dBk(t) is a Wiener 
process, so that dB(t) = (dBk(t))^ =1 is a N -dimensional Wiener process. Call P the 
noise probability distribution and E[] the expectation under P. Then, by definition, 
E[dB k (t)] = 0, V£ = 1, . . . , N, t e R, and E[dB k (s)dBi(t)] = 8 ki 8(t - s)dt where 
8m = 1 if / = k, /, k = 1, . . . , N and 8(t — s) is the Dirac distribution. 

3.6 Differential equation for the integrate regime of gIF 

Summarizing, we write Equation (6) in the form: 

dV k 

Ck~r- + gkd, co)V k = i k (t, co), (16) 
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where: 

N 

gk(t, co) = g L ,k + ^ Gkjotkjit, to). (17) 

7 = 1 

This is the more general conductance form considered in this paper. 
Moreover, 

N 

i k (f, co) = g L , k E L + J2 w kj<*kj(t, co) + 4 6Xt) (0 + (18) 

7 = 1 

where Wjy is the synaptic weight: 

W kj = E + G kj , ifjeS, 
W kj = E-G kj , if; EX. 

These equations hold when the membrane potential is below the threshold (Integrate 
regime). 

Therefore, gIF models constitute rather complex dynamical systems: the vector 
field (r.h.s) of the differential Equation (16) depends on an auxiliary "variable", which 
is the past spike sequence co^}^ and to define properly the evolution of Vk from 
time t to later times one needs to know the spikes arising before t. This is precisely 
what makes gIF models more interesting than LIF. The definition of conductances 
introduces long-term memory effects. 

IF models implement a reset mechanism on the membrane potential: If neuron k 
has been reset between s and t, say at time r, then Vk(t) depends only on V&(r) and 
not on previous values, as in (4). But, in gIF model, contrarily to LIF, there is also a 
dependence in the past via the conductance and this dependence is not erased by the 
reset. That is why we have to consider a system with infinite memory. 

3.7 The parameters space 

The stochastic dynamical system (16) depends on a huge set of parameters: the 
membrane capacities Ck, k = l,...,N, the threshold 6, the reversal potentials 
El, E + , E~, the leak conductance gL', the maximal synaptic conductances Gkj, 
k, j = 1, . . . , N which define the neural network topology; the characteristic times 
r k j 9 k, j = 1, . . . , iV of synaptic responses decay; the noise amplitude a#; and addi- 
tionally, the parameters defining the external current /^ ext ^ . Although some parame- 
ters can be fixed from biology, such as Ck, the reversal potentials, tkj , . . . some others 
such as the Gkj's must be allowed to vary freely in order to leave open the possibility 
of modeling very different neural networks structures. 

In this paper, we are not interested in describing properties arising for specific val- 
ues of those parameters, but instead in generic properties that hold on sets of param- 
eters. More specifically, we denote the list of all parameters ((Ck)^ =1 , El, E + , E~, 
(Gkj)fc j = i , • • •) by the symbol y. This is a vector in R K where K is the total number 
of parameters. In this paper, we assume that y belongs to a bounded subset TL C . 
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Basically, we want to avoid situations where some parameters become infinite, which 
would be unphysical. So the limits of H are the limits imposed by biophysics. Addi- 
tionally, we assume that gr > 0 and gb > 0. Together with physical constraints such 
as "conductances are positive", these are the only assumption made in parameters. 
All mathematical results stated in the paper hold for any y eH. 



4 gIF model dynamics for a fixed raster 

We assume that the raster co is fixed, namely the spike history is given. Then, it is 
possible to integrate the Equation (16) (Integrate regime) and to obtain explicitly the 
value of the membrane potential of a neuron at time t, given the membrane potential 
value at time s . Additionally, the reset condition (4) has the consequence of removing 
the dependence of neuron k on the past anterior to Tk(t, co). 

4.1 Integrate regime 

For h<t 2 ,ti,t 2 e M, set: 

W l9 hM = e~*ft" iu,m)du . d9) 

We have: 

r k {t\,t\,co) = r k (t 2 ,t 2 ,co) = i, 

and: 

dV k (ti,t 2 ,co) gk(h,co) 

= — r k (ti,t 2 ,co). 

oh Lk 

Fix two times s < t and assume that for neuron k, Vk(u) < 0, s < u < t so that the 
membrane potential Vk obeys (16). Then, 



■^[r k (ti,t 2 ,co)V k (ti)] = r k (t u t 2 ,co) 



= r k (t u t 2 ,co) 



dh C k 
ik(h,co) 



We have then integrating the previous equation with respect to t\ between s and t 
and setting t 2 = t: 



Ck is 



Vk(t) = r k (s 9 t 9 co)V k (s) + — I r k (tut,co)i k (tuco)dti. 

This equation gives the variation in membrane potential during a period of rest (no 
spike) of the neuron. Note, however, that this neuron can still receive spikes from the 
other neurons via the update of conductances (made explicit in the previous equation 
by the dependence in the raster plot co). 
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The term Vk(s, t, co) given by (19) is an effective leak between s, t. In the leaky 

— f f —dt — *~ s 

integrate and fire model, it would have been equal to e Js t l 1 = e t l . The term: 



def 1 f* 

Vk(s,t,co) = — / r k (ti,t,co)i k (ti,co)dti, 

Js 

has the dimension of a voltage. It corresponds to the integration of the total current 
between s and t weighted by the effective leak term Tk(t\ , t, co). It decomposes as 

V k (s, t, co) = Vl syn \s, t, co) + Vf xt \s, t, co) + V[ B \s, t, co), 

where, 

1 N C f 

vl syn \s,t,co) = —J2Wkj / r k (ti,t,co)a kj (ti,a>)dti, (20) 
C k j=1 J s 

is the synaptic contribution. Moreover, 



Vj c cA \s,t,a>) = — t T k (t u t,a>)toi + ^r \ i^\h)V k (t x ,t,co)dt x , 

?L,k Js ^k Js 

where we set: 

def C k 

?L,k = , (21) 

gL,k 

the characteristic leak time of neuron k. We have included the leak reversal potential 
term in this "external" term for convenience. Therefore, even if there is no external 
current, this term is nevertheless non-zero. 

The sum of the synaptic and external terms gives the deterministic contribution in 
the membrane potential. We note: 

Vf V t, co) = Vl syn \s, t, co) + V< ext V t, co). 

Finally, 

V[ B \s, t, co) = g f r k (t u t, co^ k (h) dh = g jf F k (tut, co) dBkih), (22) 

is a noise term. This is a Gaussian process with mean 0 and variance: 

2 r t 



e ^ r k ( tl ,t,co)dB k ( tl )^ = (^) £ rl(.h,t,a>)dti. (23) 



The square root of this quantity has the dimension of a voltage. 

As a final result, for a fixed co, the variation in membrane potential during a period 
of rest (no spike) of neuron k between s and t reads (subthreshold oscillations): 

V k (t) = r k (s, t, co)V k (s) + Vl det \s, t, co) + V ( k B) (s, t, co). (24) 
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4.2 Reset 

In Equation (4), as in all IF models that we know, the reset of the membrane potential 
has the effect of removing the dependence of V k on its past since Vk([t + T sep ]) is 
replaced by V re set- Hence, reset removes the dependence in the initial condition Vk(s) 
in (24) provided that neuron k fires between s and t in the raster co. As a consequence, 
Equation (24) holds, from the "last reset time" introduced in Section 2.10 up to time 
t . Then, Equation (24) reads 

V k (t) = Vi dct \r k (t, co), t, co) + Vi noisc) (r k (t, co), t, co), (25) 

where: 

Vf ° ise) (r^, co), t, co) = r k (x k (t, co), t, co)V reset + V[ B) (r k {t, co), t, co), (26) 
is a Gaussian process with mean zero and variance: 

ol{x k (t, co), t, co) = rl(r k (t 9 co), t, co)cf 2 R + (°^\ [ rldut, co) dh. (27) 

\^ k J Jx k (t,(o) 

5 Useful bounds 

We now prove several bounds used throughout the paper. 
5.1 Bounds on the conductance 
From (13), and since a k j(t) > 0: 
0 = a kj (t,Qo) <a kj (t,co) 

= a kj (t,Qi)<a + . 
Therefore, 

N 

gL, k = gk(f, too) < gkit, CO) < g k (t, Q X ) = g M ,k < gL,k + Ct + (29) 

7 = 1 

so that the conductance is uniformly bounded in t and co. The minimal conductance 
is attained when no neuron fires ever so that £2o is the "lowest conductance state". 
On the opposite, the maximal conductance is reached when all neurons fire all the 
time so that Q\ is the "highest conductance state". To simplify notations, we note 
x M k = -Q- . This is the minimal relaxation time scale for neuron k while tl k = ~^ Jl - 

1VI ' K gM,k gL,k 

is the maximal relaxation time. 

C k C k 
?M, k = < = • (30) 

gM,k gL, k 



{r-t { p{co)<t} 



(28) 
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5.2 Bounds on membrane potential 
Now, from (19), we have, for s <t: 

_ t—s _ t—s 

0<F k (s,t,Qi) =e r M,k < r k (s,t,co) < V k (s,t, Q 0 ) = e TL > k <1. (31) 

As a consequence, Vk(s, t, co) -> 0 exponentially fast as s -> — oo. 
Moreover, 

r k (ti,t,a))akj(ti,co)dti<a + e T ^ d*i 
= <* + r L ,£ (l - e~^ < a + r L ,£, (32) 

so that: 

— < Vf n) (,, f , a>) < — £ Wjy . (33) 

Thus, V^ syn ^(^, co) is uniformly bounded in s, t. 

Establishing similar bounds for vjf xt \s, t, co) requires the assumption that A < 
i^ xt \t) < B, but obtaining tighter bounds requires additionally the knowledge of the 
sign of A- + and of ■§- + ^ . Here, we have only to consider that: 

.(ext) 



ir ) (!)\<i + . 



In this case, 



V { ° n \s,t,c0)\ = \— ( T k (h,t,co)&h + ^- f /f xt) (fi)r*(fi,f >c ,;)cd 

I *L,k Js Js I 



so that: 



|vf xt) (M,^)| < ( I^lI + — J ( 1 - e ^ J < |E L | + — . (34) 

1 gL,*/ V / gL,k 



Consequently, 
Proposition 2 



£ W *J -(\El\ + —)< vfV t, co) < V+ 



def « + / ; + 

^ — 



def <* + ; + 



Y, w kj + \E L \ + —, (35) 



$ L ~k . $ L ~k 



4y Springer 



Page 18 of 42 



Cessac 



which provides uniform bounds in s, t, co for the deterministic part of the membrane 
potential. 

5.3 Bounds on the noise variance 

Let us now consider the stochastic part Vj^ olse \rk(t , co), t, co). It has zero mean, and 
its variance (27) obeys the bounds: 

e *m, ^ + ^-J (l-c J 
<cr£(Tk(t,co),t,co) 

t-rkM T Lk /a B \ 2 / _ 2 t-r k (t,co)\ 

If a| < (||) 2 the left-hand side is an increasing function of u = t — tk(t, co) > 
0 so that the minimum, a| is reached for u = 0 while the maximum is reached for 
u = +oo and is ^ ( g ) 2 . The opposite holds if cr 2 > ^ ( g ) 2 . The same argument 
holds mutatis mutandis for the right-hand side. We set: 

_ def . (OB lTM,k \ +def /tl,& \ 

ct * =min Uv~ CT *J ; a * =max tev~ CT *J (36) 

so that: 

Proposition 3 

0 < Ofc~ < cr k (T k (t, co), t, co) < < +oo. (37) 

5.4 The limit x k (t, co) — > — oo 

For fixed 5 and there are infinitely many rasters such that x k (t,co) < s (we remind 
that rasters are infinite sequences). One may argue that taking the difference t — s 
sufficiently large, the probability of such sequences should vanish. It is indeed possi- 
ble to show (Section 8.1) that this probability vanishes exponentially fast with t — s, 
meaning unfortunately that it is positive whatever t — s . So we have to consider cases 
where x k (t, co) can go arbitrary far in past (this is also a key toward an extension of 
the present analysis to more general conductance-based models as discussed in Sec- 
tion 9.3). Therefore, we have to check that the quantities introduced in the previous 
sections are well defined as x k (t, co) —> — oo. 

Fix s real. For all co such that x k (t,co) < s - this condition ensuring that k does 
not fire between s and t - we have, from (28), (31), 0 < T k (t\,t,co)akj(t\,co) < 

a + e %L .* , V7i e[s,t]. Now, since lim 5 _>>_oo f e %L > k dt\ = XL,k exists, the limit 

1 N ft 

lim vf n) (T k (t,cD),t,co) = —Yw kj / T k {tiJ,<o)a kj {ti,(D)dti. 

T k (t,C0)^-00 C k ~\ J-oo 
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exists as well. The same holds for the external term (tk(t , co), t , co). 

Finally, since Vk(Tk(t, co),t,co) —> 0 as Tk(t,co) —> — oo the noise term (26) be- 
comes in the limit: 

lim vj c noise) (z k (t,co),t,co) = ^ f r k (t 1 ,t,co)dB k (t 1 ), 

which is a Gaussian process with mean 0 and a variance i^) 2 fL^ {t\, t, co) dt\ 
which obeys the bounds (37). 



6 Continuity with respect to a raster 

6.1 Definition 

Due to the particular structure of gIF models, we have seen that the membrane poten- 
tial at time t is both a function of t and of the full sequence of past spikes ccF}^ . One 
expects, however, the dependence with respect to the past spikes to decay as those 
spikes are more distant in the past. This issue is related to a notion of continuity with 
respect to a raster that we now characterize. 

Definition 1 Let m be a positive integer. The m-variation of a function f(t,co) = 
/(^ W oc)is: 

var m [/(f, •)] = sup{|/(f,<w) - : co m ^ ] co'}. (38) 

where the definition of m = t] is given in Equation (5). Hence, this notion characterizes 
the maximal variation of fit,-) on the set of spikes identical from time [t] — m to 
time [t] (cylinder set). It implements the fact that one may truncate the spike history 
to time [t]—m and make an error which is at most var m [/(r, •)]. 

Definition 2 The function f(t, co) is continuous if var m [/(r, •)] -> 0 as m — > +oo. 

An additional information is provided by the convergence rate to 0 with m . The 
faster this convergence, the smaller the error made when replacing an infinite raster 
by a spike block on a finite time horizon. 

6.2 Continuity of conductances 

Proposition 4 The conductance gk(t, co) is continuous in co, for all t, for all k = 
1 iV. 

Proof Fix k = 1, . . . , N, t eW, m > 0 integer. We have, for co m =^ co'\ 
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\<Xkj(t,co) -a k j(t, co f )\ 



{r';tf'\co')<t} 



{ntf\co)<t} 



J2 a kj (t-tf\co))- J2 ^j(t-tf\co')) 



{r\ty{co)<t-m} 



{r';tf\a)')<t-m} 



since the set of firing times {t — m < t^p (go) < t}, {t —m < tj 1 ) (co f ) < t } are identical 
by hypothesis. So, since c%-(x) > 0, 

\a k j(t,co) -akj(t,Q)')\ 

< E <%M%))+ E <%M r V)) 



{r;^ r) (o;)<f-m} 



{r';tf'\co')<t-m} 



<2 <*kj(f-r). 

r<t—m 

Therefore, asm^ +oo, from (12) and setting M = t — m, 

(jfi \ _ m 
— e T ^', 

which converges to 0 as m — >► +oo. 

Therefore, from (17), g&(£, oj) is continuous with a variation 



t [gk(t 9 ')]<2^G kj P d (—\ 

7 = 1 Vr ^ y 



which converges exponentially fast to 0 as m — >► +oo. 
6.3 Continuity of the membrane potentials 



□ 



Proposition 5 77z£ deterministic part of the membrane potential, Vjf et \rk(t, co), 
t,co), is continuous and its m -variation decays exponentially fast with m. 

Proof In the proof, we shall establish precise upper bounds for the variation in 
V^ yn \tk(t, -),t,'), vjf xt \rk(t, -),t,-) since they are used later on for the proof of 
uniqueness of a Gibbs measure (Section 7.4.1). From the previous result, it is easy to 
show that, for all co m = t] co f , t\ <t2<t: 

( var OT [gfc] , v \ 

e c * (n h) -lj, 
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Therefore, from (31), 



var. 



i[r*(fi,f2,-)]<e XL > k (e 



c k 



and Vkiti ,ti,io) is continuous in co. 

Now, the product Tu(t\, t2, co)otkj (t\ , co) is continuous as a product of continuous 
functions. Moreover, 

var m [rfc(fi,*2, ')ukj(h, •)] 

< sup r^(?i,?2,^)var m [a^(^i, •)] + sxupa k j(h,co)vzr m [r k (tiJ2, •)] 



var m [gfc] 



var m [a*,- (fx ,-)] + ( e c ^ {tl h) - 1 ) ay fa , Qi) 



so that: 



'2~'l 



var m [r*(fi, f 2 , O^ ^i, •)] < e T ^ 



2P d l — )e Tk J + ( e c k 

\ T kj 



(t2-H)_ l]a + 



Since, as m —> +oo: 



var m [g^] / 



e ^te-.)_^ var m _to] fe _ fi) 



c k 



we have, 

var m [r*(fi,f 2 , OofJty 0] 



-< 2e 



, m \ -f- a+(t 2 ~h) A / m \ 



which converges to 0 as m -> +oo. 



Let us show the continuity of V^ syn \rk(t, -),t,-). We have, from (20), 

\vi syn) (r k (t, co), t, co) - vt ya) {T k {t, co'),t, co')\ 
1 N 



< 



c k 



7 = 1 
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The following inequality is used at several places in the paper. For a t\ -integrable 
function f(t\,t,co),wQ have: 



If f(t l9 t,co)dti- t f(ti,t,co')dti\ 

\Jtk(t,eo) Jz k (t,co f ) I 

ft I fT k (t,co') 

< / \f(ti,t,co) - f(ti,t 9 co')\dti + \ f(ti 9 t,o>')dti 

Jtk(t,eo) \Jz k (t,co) 



. (39) 



Here, it gives, for t\<t\ 



If r k (t u t,co)a kj (ti,co)dti- f r k (ti,t,co f )a kj (ti,co f )dti 

\Jtk(t,eo) Jx k {t,(D r ) 

< / \r k (ti,t,co)(Xkj(ti,cQ) - V k (ti, t , Q) f )a kj (ti, co f )\dti 

JT k (t,Q)) 

I fT k (t,co') 

+ / r k (ti,t,(D')a k j(ti,(D')&ti 

\Jr k (t,(o) 



For the first term, we have, 



/ \r k (ti,t,Q))a k j(ti,a)) - r k (ti,t,co f )a kj (ti,co f )\dti 

Jr k {t,(o) 

< f var m [r k (ti 9 t 9 >)a kj (ti 9 >)]dti< f var m [r*(fi, t, >)a kj (ti, •)] d*i 

Jx k {t,co) J —oo 

< f 2e"^ Pd(-) 
J-oo \*kj ) 



e ^ + 



e r L,k dri 



a + (t-t\) 



-*i)e TL <* dfi 



Let us now consider the second term. If Tk(t , co) > t — m or Tk(t , co f ) > t — m 9 then 
Tfc(f, = tk(t 9 (D f ) and this term vanishes. Therefore, the supremum in the definition 
of var m [V^ syn \r£(7, -),t, •)] is attained if tk(t 9 co) <t — m and Zk(t,co f ) <t — m. We 
may assume, without loss of generality, that Zk(t 9 co') >Zk(t 9 co). Then, from (32), 
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/ r k (ti,t,Q>')a k j(h,a)')dti 

Jx k (t,co) 

<a + f 

Jtl 



T k {t,Co') t-ti 



t—x k (t,a)') 



x k {t,a) f )-r k {t,co) 



r k(t, co) 



t-T k (t,o> f ) m 

So, we have, for the variation of V^ yn \xk(t, •), t, •), using (21): 



var m [vf n) (r^, •),;,•)] 

N 



2 Prfl— e % + J2G kr P d l— e V 



+ cr e 



so that finally, 



var„ 



with 



(40) 



(41) 



B 



(syn) 



and var m [Vt Syn ^(Ti;(?, •). t, •)] converges to 0 exponentially fast asm-> +00. 



(42) 



Now, let us show the continuity ofVj^ xt \tk(t, co), t, co) with respect to co. We have: 
\vt t \r k (t,co),t,co)-Vt t) (T k (t,co'),t,co')\ 



-\f 

\Jx k {t,co) 



— + * |r t (fi,f,a>)dfi 

*L,k ^k 



f (~ 

Jr k (t,co f ) \ T L,k 



c k 



Tk(h,t,co') d?i 



JXhU 



lr k (t,co)\ r L,k Ck 



\r k (ti,t,co)-r k (ti,t,co , )\dti 
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+ 



tk(t,co f ) 



r kit, co) 



?L,k Ck 



Tk{h,t,co f ) dt\ 



\E L \ | i+ 



Oft rn(t,co f ) \ 

\r k (ti,t,cD)-r k (ti,t,o) f )\dti+ / r k (ti,t,co f )dti) 
T k (t,co) Jr k (t,co) / 



'T k (t,CO) 

\Et I i + \ ( C* f Tk{l 
— + 7T / var m [rit(fi,f,0]^i4- / 

TL,k ^k / \Jr k (t,co) Jr k (t, 



T k (t,CO f ) t-t X 

e ^L,k dfx 



where, in the last inequality, we have used that the supremum in the variation is 
attained for r&(7, co) < t — m and Tk(t,co f ) < t — m. Finally: 



var m [vf l) (r,(r, .). t. •)] < Z*™^)''* + 



where, 



A (ext) _ o Gk J g(ext) 

^ ext) = |£zJ + — ■ 



(43) 

(44) 
(45) 



and V^ ex ^(r/ : (^, •), ^, ■) is continuous. 

As a conclusion, vjf et \xk(t, -),t,-) is continuous as the sum of two continuous 
functions. □ 

6.4 Continuity of the variance of Vj^ 01se \Tk(t , •), t, •) 

Using the same type of arguments, one can also prove that 

Proposition 6 The variance ak(Tk(t, co),t,co) is continuous in co, for all t, for all 
k=l,...,N. 

Proof We have, from (27) 

|t7fc , co), t, co) - a^(zk(t, co f ), t, co f ) \ 
<a\ W3i m [rl(r k (t,'),t,')] 

+ (7?) If rl(h,t,co)dti- f r 2 k (ti,t,to')dti 

J \Jr k (t,co) Jxk{t,co') 
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For the first term, we have that the sup in var m [r|(Tfc(f, •), t, •)] is attained for 

Tk(t, co), Tk(t, co f ) < t — m and: 

2m 

var m [rf(tfc(>, •),*, •)] <2sup{r^(Tjt(r,tw),r,tw);tws.t.Tit(r,tw) < t - m } <2e 
For the second term, we have: 

If rl(ti,t,o))dti- f rl(ti,t,o)')dti 

\Jr k (t,co) Jx k {t,o) ! ) 

ft rn(t,co') 

< / \rl(t u t,(D)-rl(t u t,(D')\dti+ / rl(ti,t,a)')dti 

Jtk(t,CO) Jtk(t,Q)) 

rt rr k (t,a) f 

< / var m [rf(ri,r,.)]d/i + / 

Jr k (t,co) J*k(t,co) 

/t 2(t-t X ) / 2vzx m [g k (t,-){t-ti)} 

e x L,k | e " C * 



•Tfc(f,a/) 2{t-t x ) 

e x L,k d/i 



1 1 dfi + ^e 



-<^var m [^(r,0] + -^e ^ 



so that finally, 



7 = 1 



with 



and continuity follows. 
6.5 Remark 



(46) 



□ 



Note that the variation in all quantities considered here is exponentially decaying 
with a time constant given by max(ry , tL,k)- This is physically satisfactory: the loss 
of memory in the system is controlled by the leak time and the decay of the post- 
synaptic potential. 



7 Statistics of raster plots 

7.1 Conditional probability distribution of Vk(t) 

Recall that P is the joint distribution of the noise and E[] the expectation under P. 
Under P, the membrane potential V is a stochastic process whose evolution, below 
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the threshold, is given Equations (24), (25) and above by (4). It follows from the 
previous analysis that: 

Proposition 7 Conditionally to co^}^, V(t) is Gaussian with mean: 



E[V*(0|g£ ] oo] = Vjf et) (T k (t, co), t,co), k = 1, . . . , N, 
and covariance: 

Cov[V k (t), V/(0|a£ ] oo] = vjcfait, co), t, co)hu k,l = l,.. 



,N 



where a^(z k (t, co),t,co) is given by (27). 

Moreover, the V k (t)'s,k = \, . . . , N are conditionally independent. 

Proof Essentially, the proof is a direct consequence of Equations (24), (25) and the 
Gaussian nature of the noise Vj[ noise ^(Tk(f, co), t, co). The conditional independence 
results from the fact that: 

Cov[V k (t), V/WI^-U 

= 7^ E IT r k (t 1 ,t,co)dB k (t 1 ) f r l (t 2 ,t,co)dB l (t 2 ) 

^k^l Utk(t,co) Jri(t,(o) 

+ Cov[r*(r*(f, co),t, co)V Yeset , Ti(ri(t, co),t, co)V Yeset ] 
= 7^F f f ^k(tiJ,co)r l (t 2 ,t,co)E[dB k (t l )dB l (t 2 )] 
+ alrl(T k (t,co),t,co)8 k i 



: hi 



c k 



2 pt pt 

/ / 



T k {ti,t, co)F k (t 2 , t,co)8(h- t 2 ) dh dt 2 



□ 



+ alTl(x k (t,co),t,co) 
= al(x k {t,co),t,co)8 k i. 
7.2 The transition probability 



We now compute the probability of a spiking pattern at time n = [t], co(n), given the 
past sequence cJ!^ . 

Proposition 8 The probability of co(n) conditionally to clPT^ is given by: 



P[co(n)\co n _-^] = fl P[co k (n)\co n _-£\, 



(47) 



k=\ 
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with 

P[o) k (n)\co n _-^] = co k (n)7t(X k (n - I, to)) 

+ (1 - co k (n)){\ -n(X k (n - l,co))), (48) 

where 

0 - Vi det \r k (n - I, co), n-l, to) 

X k (n -l,co) = k - — — — — , (49) 

o k (x k (n - \,co),n - \,co) 



and 



a/2tt fx 



e~^dw. (50) 



Proof We have, using the conditional independence of the V k (n)'s\ 
P[co{n)\co n _-£\ 

N 

= Y\(co k (n)P[V k (n - 1) >0\co n _-^] + (l - co k (n))P[V k (n - 1) < 0\co n _-^]). 
k=\ 

Since the V k (n — l)'s are conditionally Gaussian, with mean vjf et \r k (n — l,co), 
n — 1, co) and variance a^(x k (n — l,co),n — 1, co), we directly obtain (47), (48). 
Note that since o k (x k (n — 1, co), n — 1, co) is bounded from below by a positive 

quantity (see (37)), the ratio g ~^ ( ^^i~) , ^i~ 1 ) ,a)) in (48) is defined for all co e 

x. k ,co,n ^ □ 



7.3 Chains with complete connections 



The transition probabilities (47) define a stochastic process on the set of raster 
plots where the underlying membrane potential dynamics is summarized in the 
terms V^ det ^(r^(^ — 1, co), n — 1, co) and o k (x k (n — \,co),n — \,co). While the inte- 
gral defining these terms extends from x k (n — 1 , co) to n — 1 where x k (n — 1 , co) 
can go arbitrary far in the past, the integrand involves the conductance g k (n — 1 , co) 
that summarizes an history dating back to s = — oo. As a consequence, the proba- 
bility transitions generate a stochastic process with unbounded memory, thus non- 
Markovian. One may argue that this property is a result of our procedure of taking 
the initial condition in a infinite past s —> — oo, to remove the unresolved dependency 
on gk(s) (Section 3.4). So the alternative is either to keep s finite in order to have a 
Markovian process; then, we have to fix arbitrarily g k (s) and the probability distri- 
bution of V k (s). Or we take s -> — oo, removing the initial condition, to the price of 
considering a non-Markovian process. Actually, such processes are widely studied in 
the literature under the name of "chains with complete connections" [43, 46-49] and 
several important results can be used here. So we adopt the second approach of the 
alternative. As a by-product, the knowledge of the Gibbs measure provided by this 
analysis allows a posteriori to fix the probability distribution of V k (s). 
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For the sake of completeness, we give here the definition of a chain with complete 
connections (see [43] for more details). For wgZ, we note JlL^ the set of sequences 
cc^Sqq and T< n -\ the related a -algebra, while T is the a -algebra related with X = 
A z . V(X, T) is the set of probability measures on (X, T). 

Definition 3 A system of transition probabilities is a family {P n } ne z of functions 

P n [\]:AxA n _-^^[0,l], 
such that the following conditions hold for every n e Z: 

• For every co(n) e A, the function P n [co(n)\.] is measurable with respect to T< n -\. 
. For every aT^ e A n S^ 

E Pn[co(n)\co n _^] = l. 

(o(n)eA 

A probability measure fi in V(X, T) is consistent with a system of transition prob- 
abilities {P n }neZ if for all n e Z and all T< n -measurable functions /: 

j f(co n _ co ) f i(dco) = j J2 /K~^W)^hWI^]M(cto). 

co(n)eA 

Such a measure fi is called a "chain with complete connections consistent with 
the system of transition probabilities {P n }nez"- 

The transitions probabilities (47) constitute such a system of transitions probabili- 
ties: the summation to 1 is obvious while the measurability follows from the continu- 
ity of P n {(D{n)\(D n S^\ proved below. To simplify notations, we write p(n,co) instead 
of Pft[co(ft)|a/^] whenever it makes no confusion. 

7.4 Existence of a consistent probability measure fi 

In the definition above, the measure /x summarizes the statistics of spike trains from 
—oo to +oo. Its marginals allow the characterization of finite spike blocks. So, fi 
provides the characterization of spike train statistics in gIF models. Its existence 
is established by a standard result in the frame of chains with complete connec- 
tions stating that a system of continuous transition probabilities on a compact space 
has at least one probability measure consistent with it [43]. Since tv is a continu- 
ous function the continuity of p(n, co) with respect to co follows from the continu- 
ity of V^ Qi \xk(n — 1, co), n — 1, co) and the continuity of a^ixkin — 1, co), n — 1, co), 
proved in Section 6. 

Therefore, there is at least one probability measure consistent with (47). 

7.4.7 The Gibbs distribution 

A system of transition probabilities is non- null if for all n e Z and all co n _~^ e A n _~^, 
P[to(ft)|a/1^] > 0. Following [50], a chain with complete connection [i is a Gibbs 
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measure consistent with the system of transition probabilities p(n, •) if this system 
is continuous and non-null. Gibbs distributions play an important role in statistical 
physics, as well as ergodic theory and stochastic processes. In statistical physics, 
they are usually derived from the maximal entropy principle [14]. Here, we use them 
in a more general context affording to consider non- stationary processes. It turns 
out that the spike train statistics in gIF model is given by such a Gibbs measure. In 
this section, we prove the main mathematical result of this paper (uniqueness of the 
Gibbs measure). The consequences for spike trains characterizations are discussed in 
the next section. 



Theorem 1 For each choice of parameters y eH, the gIF model (16) has a unique 
Gibbs distribution. 



The proof of uniqueness is based on the following criteria due to Fernandez and 
Maillard [50]. 



Proposition 9 Let. 



m(p) — inf inf p(n,co), 



and 

v(p) = sup V ™ n -m>[p(n, •)]• 

Ifm(p) > 0 and v(p) < oo, then there exists at most one Gibbs measure consistent 
with it. 



So, to prove the uniqueness, we only have to establish that 

m(p) > 0, (51) 
v(p) < +oo. (52) 

Proof m(p) > 0. 
Recall that: 

N 

p(n, co) = Y\[co k (n)7t(X k (n - 1, co)) + (l - co k (n))(l -7t(X k (n - 1, co)))]. 
k=i 

From (35), (37), we have: 



oo < — — < X k (n -l,o))< ^ < +oo. (53) 



In [50], the authors use the following definition for the n, m variation, which reads in our notations: 
\ar' m [p(n, •)] = sup{|/?0, co) — p(n, co')\; oo, co' e A n _ OQ , oo 1 ^ = oo'^ } , m < n. 

It differs therefore slightly from our definition (5), (38). The correspondence is \ar' m [p(n, •)] = 
\&x n - m [p{n, •)]• The definition of v(p) takes this correspondence into account. 
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Since n, given by (50), is monotonously decreasing, we have: 



0 < 7t k = It 



def (0-V-\ . / ^ xX , def (Q-V2 



<Tc(X k (n-l,C0)) <7T+ = 7T ^- < 1 



so that: 



0 < = f min(7r^, 1 - tt^) < a) k (n)TCj^ + (l - ^(n))(l - 7i^) < tw) 
< CD k (n)7t£ + (l - 6>*(n))(l - tt^) < = f max(7r^ + , 1 - tt^) < 1. (54) 
Finally, 

iV 

m(^)>nn->o, 

which proves (51). This also proves the non-nullness of the system of transition prob- 
abilities. 

v(p) < oo. 

The proof, which is rather long, is given in the appendix. □ 



8 Consequences 

8.1 The probability that neuron k does not fire in the time interval [s,t] 

In Section 4.2, we argued that this probability vanishes exponentially fast with t — s. 
This probability is /ji[(^L^ +1 {cOk(n) = 0}]. We now prove this result. 

Proposition 10 The probability that neuron k does not fire within the time interval 
[s,t], t — s > 1 has the following bounds: 



o < n [ !_ ] ~ [s] < ix 



■ it] 

pi =o} 

.n=[s]+l 



< n [ l ] - [s] < l, 



for some constants 0<n_<n + <l depending on the system parameters y eH. 



Proof We have: 



[t] 



pi =o} 

.71=[,S] + 1 



■ m 

p| {a) k (n) = 0} 

n=[s]+l 
[t] 



dfjL(oo) 



= f A w ft M[K(«) = 0}|^]d^M 



> n=[s]+l 
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= / w 11 P[co k (n) = 0\co n _-^]dfi(co) 9 



where P[^(n) = Olo/^] is given by (47) and obeys the bounds (54). Therefore, 
setting n_ = Ylk=i and n + = f[*Li n£, we have 



n?- w f r 1 d M M = nW" w < /x[r,a, *>) < s ] < n[[ ] " [s] f d^) 

8.2 Back to spike trains analysis with the maximal entropy principle 

Here, we shortly develop the consequences of our results in relation with the statis- 
tical model estimation discussed in the introduction. A more detailed discussion will 
be published elsewhere (in preparation and [51]). Set: 



4>(n, co) = f log p(n, co) = ^^0^(n, co), (55) 



def 

log p{n, co) = 

k=l 

with, 



(j>k (n , co) == cok (n) log tt (X^ (n — 1 , co)) 

+ (1 - co k (n)) log(l -n(X k (n - l,co))). (56) 

The function 0 is a Gibbs potential [52]. Indeed, we have Vm < n, Va/L^: 

n 
l=m 

This equation emphasizes the connection with Gibbs distributions in statistical 
physics that considers probability distributions on multidimensional lattices with 
specified boundary conditions and their behavior under space translations [52]. The 
correspondence with our case is that "time" is represented by a mono-dimensional 
space and where the "boundary conditions" are the past co™~^ . Note that in our case, 
the partition function is equal to 1 . 

For simplicity, assume stationarity (this is equivalent to assuming a time- 
independent external current). In this case, it is sufficient to consider the potential 
at time n = 0. 

Thanks to the bounds (53), one can make a series expansion of the functions 
log(7r) and log(l — tt) and rewrite the potential under the form of the expansion: 

+oo R 

cp(0,co) = ^ ^ ^ hki,ni),...,(k r ,n r )0)ki(ni) • • ■ co kr (n r ) (57) 

R=l r =\ {(ki,ni),...,(k r ,n r )eV(N,R)} 
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where V(N, R) is the set of non-repeated pairs of integers (k, N) with k e {1, . . . , N] 
and n e {— R,...,Q}. We call the product co^ (n\) • • • cok r (n r ) a monomial. It is 1 if 
and only if neuron k\ fires at time n\, . . . , k r fires at time n r . The A^^),...,^,^)^ 
are explicit functions of the parameters y . Due to the causal form of the potential, 
where the time-0 spike, &>&(0), is multiplied by a function of the past &>Z^, the poly- 
nomial expansion does not contain monomials of the form co^ (0) • • • cok r (0), r > 1 
(the corresponding coefficient A vanishes). 

Since the potential has infinite range, the expansion (57) contains infinitely many 
terms. One can nevertheless consider truncations to a range R = D + 1 corresponding 
to truncating the memory of the process to some memory depth D. Note that although 
truncations with a memory depth D are approximations, the distance with the exact 
potential converges exponentially fast to 0 as D -> +oo thanks to the continuity of 
the potential, with a decay rate controlled by synaptic responses and leak rate. 

The truncated Gibbs potential has the form: 

0< d V-z>) = £*/<M*> o -d); (58) 

/ 

where / stands for (k\, n\ ),..., (k r , n r ) and is an enumeration of the elements in 
V(N, D + 1) and where 0/ is the corresponding monomial. Due to the truncation, 
(58), contrarily to (55), is not normalized. Its partition function 3 is not equal to 1, and 
its computation becomes rapidly intractable as soon as the number of neurons and 
memory depth increases. 

Clearly, (58) is precisely the form of potential which is obtained under the maximal 
entropy principle, where the 0/ 's are constraints of type "neuron k\ is firing at time 
n\, neuron hi is firing at time n2, . . . " and the A/ 's the conjugated Lagrange multipli- 
ers. Thus, using the maximal entropy principle to characterize spike statistics in the 
gIF model by expressing constraints in terms of spike events (monomials), one can 
at best find an approximation which can be rather bad, especially if those constraints 
focus on instantaneous spike patterns (D = 0) or short memory patterns. Moreover, 
increasing the memory depth to approach better the right statistics leads to an ex- 
ponential increase in the number of monomials which becomes rapidly intractable. 
Finally, the Lagrange multipliers A/ are rather difficult to interpret. 

On the opposite, the analytic form (55) depends only on a finite numbers of pa- 
rameters (y) constraining the neural network dynamics, which have a straightforward 
interpretations being physical quantities. This shows that, at least in gIF model, the 
linear Gibbs potential (58) obtained from the maximal entropy principle is not re- 
ally appropriate, even for empirical/numerical purposes, and that a form (55) where 
the infinite memory is replaced by coZ]) could be more efficient although non- 
linear. 



3 For D > 0, this is Z(co_ l D ) = J2co(0) e ^ ^ m -d\ ensuring that _ 1 ° is a conditional probability 

P[co(0)\coZ])]- Hence, it is not a constant but a function of the past coT} d , in a similar way to statistical 
physics on lattices where the partition function depends on the boundary conditions. Only in the case 
D = 0 (memory less) is this a constant. 
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To finish this section, let us discuss the link with Ising model in light of the 
present work. Ising model corresponds to a memory-less case, hence to D = 0. 
Since the causal structure of the Gibbs potential forbids monomials of the form 
a>k x (0) • • • cok r (0), the D = 0 expansion of the gIF-Gibbs potential corresponds to a 
Bernoulli distribution where neurons are independent 0^(0, co) = J2k=i ^k^>k(0)- 
The Ising model is therefore irrelevant to approximate the exact potential of gIF 
model, if one wants to reproduce spike statistics at the minimal discretization time 
scale 8 without considering memory effects. 

However, in real data analysis, people are usually binning data, with a time win- 
dows of width w ~ 10-20 ms. Binning consists of recoding the raster plot with 
spikes amalgamation. The binned raster b consists of "spikes" bk(n) e {0, 1} where 
bk(n) = 1 if neuron k fired at least once in the time window [nw, (n + l)w[. In 
the expansion (57), this corresponds to collecting all monomials corresponding to 
bk(n) = 1 in a unique monomial. In this way, the binned potential contains indeed 
an Ising term. . . that mixes all spike events occurring within the time interval w . 
These events appear simultaneous because of binning, leading to the Ising pairwise 
term bj^ (0)bk 2 (0) while events occurring on smaller time scales are scrambled by this 
procedure. 

The binning effect on Gibbs potential requires, however, a more detailed descrip- 
tion. This will be discussed elsewhere. 



9 Discussion 

To conclude this paper, we would like to discuss several consequences and possible 
extensions of this work. 

9.1 The spike time discretization 

In gIF model, membrane potential evolves continuously while conductance is up- 
dated with spike occurrence considered as discrete events. Here, we discuss this time 
discretization. Actually, there are two distinct questions. 

9.7.7 The limit of time -bin tending to 0 

This limit would correspond to a case where spike is instantaneous and modeled by a 
Dirac distribution. As discussed in [32], this limit raises serious difficulties. To sum- 
marize, in real neurons, firing occurs within a finite time 8 corresponding to the time 
of raise and fall for the membrane potential. This involves physicochemical processes 
that cannot be instantaneous. The time curse of the membrane potential during the 
spike is described by differential equations, like Hodgkin-Huxley's [35]. Although, 
the time scale dt appearing in the differential equations has the mathematical mean- 
ing of being arbitrary small, on biophysical grounds, this time scale cannot be arbi- 
trary small, otherwise the Hodgkin-Huxley equations loose their meaning. Indeed, 
they correspond to an average over microscopic phenomena such as ionic channels 
dynamics. In particular, their time scale must be sufficiently large to ensure that the 
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description of ionic channels dynamics (opening and closing) in terms of probabil- 
ities is valid so dt must be larger than the characteristic time of opening-closing of 
ionic channels Tp. Additionally, Hodgkin-Huxley's equations use a Markovian ap- 
proach (master equation) for the dynamics of h, m, n gates. This requires that the 
characteristic time dt is quite a bit larger than the characteristic time of decay for 
the time correlations between gates activity tq • Summarizing, we must have 0 < tq , 
Tp < dt < 8. Thus, on biophysical grounds, 8 cannot be arbitrary small. 

In our case, the 8 -> 0 limit is armless, however, provided we keep a non-zero re- 
fractory period, ensuring that only finitely many spikes occur in a finite time interval. 
Taking the limit 8^0 without considering a refractory period raises mathematical 
problems. One can in principle have uncountably many spikes in a finite time interval 
leading to the divergence of physical quantities like energy. Also, one can generate 
nice causal paradoxes [37]. Take a loop with two neurons one excitatory and one in- 
hibitory and assume instantaneous propagation (the a profile is then represented by 
a Dirac distribution). Then, depending on the synaptic weights value, one can have 
a situation where neuron 1 fires instantaneously and make instantaneously 2 firing 
which prevents instantaneously 1 from firing and so on. So taking the limit 8 —> 0 as 
well as r re fr —> 0 induces pathologies not inherent to our approach but to IF models. 

9. 7. 2 Synchronization for distinct neurons 

There is a more subtle issue pointed out in [53]. We do not only discretize time for 
each neuron' spikes, we align the spikes emitted by distinct neurons on a discrete- 
time grid, as an experimental raster does. As shown in [32] this induces, in gIF mod- 
els with a purely deterministic dynamics (no noise and reset to a constant value), an 
artificial synchronization. As a consequence, the deterministic dynamics of gIF mod- 
els has generically only stable periodic orbits, although periods can be larger than any 
accessible computational time in a specific region of the parameters space. Addition- 
ally, these periods increase as 8 decreases. The addition of noise on dynamics and on 
the reset value, as we propose in this paper, removes this synchronization effect. 

9.2 Refractory period 

In the definition of the model, we have assumed that the refractory period r re f was 
smaller than 1 . The consequence for raster plots is that one can have two consecu- 
tive l's in the spike sequence of a neuron. The extension to the case where r re f > 1 
is straightforward for spike statistics. Having such a refractory period forbids some 
sequences. For example, if 1 < r re f < 2, then all sequences containing two consec- 
utive l's for one neuron (1,1) are forbidden. If 2 < r re f < 3 sequences containing 
1, *, 1 for a given neuron, where * = 0, 1, are forbidden, and so on. More generally, 
the procedure consisting of forbidding specific (finite) spike blocks is equivalent to 
introducing a grammar in the spike generation. This grammar can be implemented in 
the Gibbs potential: forbidden sequences have a potential equal to — oo (resp. a zero 
probability). In this case, X = A z , the set of all possible rasters, becomes a subset 
where forbidden sequences have been removed. 
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9.3 Beyond IF models 

Let us now discuss the extension of the present work to more general models of 
neurons. First, one characteristic feature of integrate and fire models is the reset, 
which has the consequence that the memory of activity preceding the spike is lost 
after reset. Although in the deterministic (noiseless) case, this is a simplifying feature 
allowing for example to fully characterize the asymptotic dynamics of (discrete time) 
IF models [32, 54], here, it somewhat renders more complex the analysis. Indeed, 
it led us to introduce the notion of "last reset" time and, at some point in the proof 
(see, e.g., Equation (39)), obliged us to consider several situations (e.g., tk(t, co) > 
t — m or Tk(t, co') > t — m versus Tk(t, co) < t — m and Tk(t, co') < t — m in the 
proof of continuity, Section 6). On the opposite, considering a model where no such 
reset occur would simply lead us to consider a model where Tk(t,co) -> — oo, V&>, 
This case is already considered in our formalism, and actually, considering that 
tk(t, co) —> — oo, V&), Wk simplifies the proofs (for example it eliminates the second 
term in Equation (39)). 

As a matter of fact, the theorems established in this paper should therefore also 
hold without reset. But this requires to replace the firing condition (4) by another 
condition stating what the membrane potential does during the spike. Although it 
could be possible to propose an ad hoc form for the spike, it would certainly be more 
interesting to extend the results here to models where neurons activity depends on 
additional variables such as adaptation currents, as in the FitzHugh-Nagumo model 
[39-42], or activation-inactivation variables as in the Hodgkin-Huxley model [35]. 

The present formalism affords an extension toward such models, where the neuron 
fires whenever its membrane potential belongs to a region of the phase space, which 
can be delimited by membrane potentials plus additional variables such as adapta- 
tion currents or activation-inactivation variables, and where the spike is controlled 
by the global dynamics of all these variables. But while here the firing of a neuron 
is described by the crossing of a fixed threshold, in the FitzHugh-Nagumo model, it 
is given by the crossing of a separatrix in the plane (voltage-adaptation current) and 
by a more complex "frontier" in the Hodgkin-Huxley model [2, 55]. One difficulty 
is to precisely define this region. To our knowledge, there is no clear agreement for 
the Hodgkin-Huxley model (some authors [2] even suggest that the "spike region" 
could have a fractal frontier). The extension toward FitzHugh-Nagumo seems more 
manageable. 

Finally, the most important difficulty toward extending this paper results in more 
realistic neural networks is the definition of the synaptic spike response. In IF mod- 
els, the spike is thought as a punctual "event" (typically, an "instantaneous" pulse) 
while the synaptic response is described by a convolution kernel (the a -profile). This 
leads one to consider a somewhat artificial mixed dynamics where membrane poten- 
tial evolves continuously while spike are discrete events. In more realistic models, 
one would have to consider kinetic equations for neurotransmitter release, receptor 
binding and opening of post- synaptic ionic channels [5, 44]. Additionally, the consid- 
eration of these mechanics deserves a spatially extended modeling of the neuron, with 
time delays. In this case, all variables evolve continuously and the statistics of spike 
trains would be characterized by the statistics of return times in the "spike region". 
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This statistics is induced by some probability measure in the phase space; a natural 
candidate would be the Sinai-Ruelle-Bowen measure [56-58], for stationary dynam- 
ics, or the time-dependent SRB measure for non- stationary cases, as defined, e.g., in 
[59]. These measures are Gibbs measures as well [60]. Here, the main mathematical 
property ensuring existence and uniqueness of such a measure would be uniform hy- 
perbolicity. To our knowledge, conditions ensuring such a property in networks have 
not been established yet neither for Hodgkin-Huxley's nor for FitzHugh-Nagumo's 
models. 

9.4 Synaptic plasticity 

As the results established in this paper hold for any synaptic weight value in H, they 
hold as well for networks underlying synaptic plasticity mechanisms. The effects of 
a joint evolution of spikes dynamics, depending on synaptic weights distributions, 
and synaptic weights evolution depending on spike dynamics have been studied in 
[61]. In particular it has been shown that mechanisms such as Spike-Time-Dependent 
Plasticity are related to a variational principle for a quantity, the topological pressure, 
derived for the thermodynamic formalism of Gibbs distributions. In the paper [61], 
the fact that spike trains statistics were given by a Gibbs distribution was a working 
assumption. Therefore, the present work establishes a firm ground for [61]. 

Appendix 

Here, we establish (52). We use the following lemma. 

Lemma 1 For a collection 0 < a k , a' k < 1, VA: = 1, . . . , N, we have 




(59) 



k=i 



k=i 



This lemma is easily proved by recursion. 
We have, for n e Z, m > 0 




where: 



a) k (n)7t{X k (n - l,co)) + (l -o) k (n))(\ -Tt{X k (n - \,oo) 
4(rc)7r(^(rc-lV)) + (l — oo f k (nj)(\ — 7t{X k (n — l,co' 



«')))• 



Therefore, using inequality (59), 




k=l 
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The condition co ^ oJ implies ft)&(ft) = co f k (n) so that: 

\a,k — a k \ = \n (Xk(n — 1, co)) — n(Xk(n — 1, ft/)) |. 

We have 

\n(X k (n - l,co)) -7t(X k (n - l,co')) \ < \X k (n - l,co)-X k (n - 1, ft/) | f^'l^, 
with Htt'Uoo = sup XGM Itt'OOI = -±=, so that 



2tt' 

1 N 

var m [p(n, •)] < -= var m [X^ (n - 1, •)]• 
V2tt 



We have now to upper bound var m [X^(n — 1, •)] = sup{\Xk(n — 1, co) — Xk(n — 1, 
a/) |; <w m = 1 ft/}. We have 

var m [X*(w - 1, •)] 



,(det)/ ^ • - ^ 1 



< var m [# - Vjf et) (z k (n - 1, •), /i - 1, ■)] sup 



wex cr k (r k (n - 1, ft)), ft - 1, ft)) 



+ sup |0 — e (rk(n — 1, ft)), ft — 1, ft)) | 



1 



crk(?k(n - 1, 0,ft - 1, 0. 



with, 

var m [# - Vf et) (T k (n - 1, ■), /i - 1, ■)] = var m [ vf et) (r k (ft - 1, •), * - 1, •)] 
< var m [vf yn) (r^(ft - 1, -),ft - 1, •)] + var m [vf xt \z k (n - 1, -),ft - 1, •)] 
so that, from (40), (43): 



var m [c9-Vf et) (^(ft-l,.),ft-l,-)] 



(60) 



2< 

7 = 1 



where: 



^(det) _ ^(syn) ^(ext) 
kj kj kj 



(see Equations (41), (44)) and: 



(see Equations (42), (45)). 
Moreover, from (37), 



1 1 

sup < — . (61) 

aieX °k(n(n ~ 1, ft>), ft - 1, ft)) or. 
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From (35), 



sup \6 - Vjf et) (z k (n - 1, co), n- \,co)\< max(|<9 - V~ |, |<9 - V+|). (62) 

coeX 



Finally, 



var„ 



1 



Vk(n(n ~ 1, ■),«- 1, •) 



< var m [a^(r^(n - 1, ■),"- 1, •)] SU P 9/ : : — : : — r 

coeX cr^itkin - 1, co), n-l,co) 



vsLT m [a k (z k (n - 1, - 1, •)]> 



while 



var m [a^(r^(n - 1, -),n- 1, •)] > 2^ var m [a^(r^(n - 1, -),n- 1, •)], 
from (37), so that: 

var m [a^(r^(n - 1, -),n- 1, •)] < — ^ var m [o^ 2 (t* (n - 1, - 1, ■)], 



and, from (46), 



var™ 



_cr k (z k (n - 1, ■),«- 1, •) 



-;'=i 



2/// 



Summarizing (60), (61), (62), (63) 



var* 



,[X k (n - 1, •)] * ^(g AS et) P^)e-f + fl<* 



■m^[\9-V k -\,\9-V k + \] 

N 



1 



E A g^(^) c " v+c ^ )e "^ 



(63) 



Therefore, we have: 



, y . / ill \ m l V \ — tv\ — 

var m [X t (n-l,-)]:<E4?M — ) e ^ +** e rL '*+C£ X) e rL - 



for constants Aj^\ fif 0 , cf°. 



^ Springer 



Journal of Mathematical Neuroscience (2011) 1:8 



Page 39 of 42 



As a consequence, 



var m [p(n,.)]<^=J2 



j=i V ^' y 



2m 



Therefore, Y2 n>m ' \dx n - m >[p(n, •)] is bounded from above by the series 



/2tt 



E 

£=i 



J=l n>m' 



Tkj 



e T ^ + B { k X) e TL 



k 



n>m' 



, 2(n-m r ) 

n>m' 



I27X 



E 



E^fE^ffV^+^E^^ 

.; = ! />0 



/>0 



l>0 



which converges, uniformly in m' . As a consequence, in (52), v(p) < +oo and we 
are done. 
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